ATTORNEY DOCKET NO. 126239-1021 



PATENT 



SYSTEM AND METHOD FOR MULTIMEDIA DISPLAY 

TECHNICAL FIELD OF THE INVENTION 

This invention is related in general to the field of 
control systems, particularly to a system and method of 
multimedia display. 
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BACKGROUND OF THE INVENTION 

In a control area network connecting various control 
devices, a monitor or user display device is often used to 
provide a current status information about the control area 
network. In many instances, it becomes desirable to feed 
multiple graphics information from a number of sources to the 
monitor for display simultaneously. 
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SUMMARY OF THE INVENTION 

It has been recognized that it is desirable to provide a 
multimedia display on a monitor. 

In one aspect of the invention, a system of multimedia 
display on a monitor screen includes at least one graphics 
source, a display file defining a page having a plurality of 
buttons, where each button has a set of properties including a 
specification of a graphics source. The system further includes 
a graphics controller operable to generate a pixel map, and a 
graphics arbitrator coupled to the graphics controller operable 
to select pixels between the pixel map and pixels from the at 
least one graphics source to be displayed for the page according 
to the display file. 

In another aspect of the invention, a control area network 
having a multimedia display includes a master controller coupled 
to the control area network, and at least one control device 
coupled to the master controller via the control area network. 
The at least one control device includes at least two graphics 
sources, a display file defining a page having a plurality of 
buttons, each button having a set of properties including a 
specification of a graphics source, a graphics controller 
operable to generate a pixel map. A graphics arbitrator is 
coupled to the graphics controller and is operable to select 
pixels between the pixel map and pixels from the at least two 
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graphics sources to be displayed on a monitor screen for the 
page according to the display file. 

In yet another aspect of the invention, a method of 
multimedia display on a monitor screen includes composing a 
display file describing multiple buttons, each button having a 
set of properties including a specification of a graphics 
source, receiving a pixel from each graphics source, and 
generating a corresponding pixel in response to the display 
file. The generated pixel is then examined and a pixel is 
selected from the generated pixel and the corresponding pixels 
from the graphics sources in response to examining the generated 
pixel. The selected pixel is displayed on the monitor screen. 

In yet another aspect of the invention, a method of 
multimedia display on a touch monitor screen in a control area 
network is provided. The method includes the steps of composing 
a display file describing multiple buttons, each button having a 
set of properties including a specification of a graphics source 
coupled to the control area network. Thereafter, the method 
includes receiving a pixel from each graphics source, generating 
a corresponding pixel in response to the display file, and 
examining the generated pixel. A pixel is then selected from the 
generated pixel and the corresponding pixels from the graphics 
sources in response to examining the generated pixel. 
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One technical advantage of the invention is the ability to 
display graphics content from multiple sources on a single page 
on a monitor screen. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the present invention, 
reference may be made to the accompanying drawings, in which: 

FIGURE 1 is a simplified block diagram of an embodiment of 
a system for multimedia display according to the teachings of 
the present invention; 

FIGURE 2 is a more detailed block diagram of an embodiment 
of the display interface according to the teachings of the 
present invention; 

FIGURE 3 is a detailed block diagram of an embodiment of 
the display interface according to the teachings of the present 
invention; 

FIGURE 4 is an exemplary screen of a main editor page with 
a page editing menu according to the teachings of the present 
invention; 

FIGURE 5 is an exemplary screen of a main editor page with 
a button editing menu according to the teachings of the present 
invention; 

FIGURE 6 is an exemplary screen of a button property 
editing page according to the teachings of the present 
invention; and 

FIGURE 7 is an exemplary flowchart of a graphics 
arbitration process according to the teachings of the present 
invention. 
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DETAILED DESCRIPTION OF THE INVENTION 

FIGURE 1 is a simplified block diagram of an embodiment of 
a system for multimedia display 10 according to the teachings of 
the present invention. System 10 includes a display interface 12 
which is operable to accept graphics and text input from a 
variety of sources 14. Graphics sources 14 may include a 
television 16 (or a receiver of television signals) , a video 
cassette recorder (VCR) 11, a computer 18, and a camera 19. 
Other input sources may include digital video discs (DVDS), 
satellite receivers, video conferencing systems, etc. The inputs 
may be in the form of VGA, SVG, XGA, RGB, and other suitable 
formats. Display interface 12 is further operable to receive a 
pointing device, such as a mouse or touch pad 22. A display 24 
such as a VGA monitor, RGB monitor, touch panel, etc. may be 
coupled to display interface 12. Display 24 may be a touch 
monitor or a monitor with a touch membrane overlay. Display 24 
is operable to show a composite page consisting of one or more 
windows or "'buttons'' which display graphics from multiple 
sources 16-19 coupled to display interface 12. 

Display interface 12 may be coupled to a control system 26, 
which may include a master controller 28, which is coupled to a 
control area network (CAN) 30. Also coupled to control area 
network 30 and under the control of master controller 28 are 
control devices 32. Control devices 32 may be lights, audio- 
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visual equipment, user displays, security equipment, fire 
detection equipment, and other equipment and devices. Control 
devices 32 may include sources of graphics content, which may be 
communicated to master controller 28 via control area network 30 
to display interface 12. Display 24 thus may also display 
content from graphics sources coupled to control area network 
30. 

FIGURE 2 is a more detailed block diagram of an embodiment 
of the display interface 12 according to the teachings of the 
present invention. Display interface 12 includes one or more 
connectors or slots 40-42 to receive graphics sources 14. 
Graphics sources 14 may be coupled to graphics input cards or 
modules which may connect to connectors or slots 40-42. It may 
be seen that a graphics source for display interface 12 may be 
another display interface 52, which may in turn be coupled to 
yet another display interface 54 in a daisy chain fashion. 
Therefore, a graphics input source coupled to display interfaces 
52 and 54 may be displayed on display 24 coupled to display 
interface 12 along with control devices 32 of control area 
network 30. Graphics sources 14 are coupled to a graphics 
arbitrator 46 via connectors 40—42. Graphics arbitrator 46 
provides a graphics output that may include a combination of 
graphics generated internally, video information from all 
graphics sources 14 and other sources coupled to display 
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interface 12. The graphics output is provided to and displayed 
by display 24 . 

Graphics arbitrator 46 generates the graphics output in 
response to display files 50, which are generated by an editor 
48. A user or installer may initiate editor 48, which is an 
application program executing on a central processing unit (CPU) 
of display interface 12. The user may define and designate 
multiple windows or buttons in which graphics content from 
various sources 14 is displayed. 

FIGURE 3 is a detailed block diagram of an embodiment of 
the display interface 12 according to the teachings of the 
present invention. Display interface 12 includes three 
video/graphics input slots or connectors 40-42 for receiving 
graphics information from at least three graphics sources. In 
one embodiment, video graphics cards operable to receive and 
process certain particular types of graphics data may be plugged 
into slots 40-42. For example, a graphics card may be provided 
that is operable to couple to consumer-type sources, such as 
VCRs and DVDS. Such graphics card may include S-video input 
connectors and/or composite input connectors. Another graphics 
card may include RGB connectors operable to couple to RGB-type 
sources. Yet another graphics card may include VGA connectors 
for coupling with VGA-type sources. In general, the graphics 
cards are operable to decode a given type of video signal into 
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24-bit RGB, then buffering, scaling, and outputting a specific 
number of pixels at a time to graphics arbitrator 46 in sync 
with the horizontal and vertical sync signals from main 
processor 60. Main processor 60 may request a graphics card to 
scale its output image by sending it commands. The output image 
can be adjusted so that the active video data appears in the 
requested rectangular area. For example, main processor 60 may 
generate and send a SET OUTPUT RECTANGLE command message with 
the coordinates of the four corners of the output rectangle as 
parameters . 

Coupled to video/graphics input slots 40-42 is graphics 
arbitrator 46. Graphics arbitrator is under the control of main 
processor 60. Main processor 60 also controls a graphics 
controller 62, which generates a pixel clock signal that cycles 
once for every pixel on the display. The pixel clock signal is 
distributed to video/graphics input slots 40-42 and is used as 
the main video timing signal. Graphics controller 62 also 
generates the internal graphics or RGB data for each pixel, 
which is provided to graphics arbitrator 46. Also provided to 
graphics arbitrator 4 6 are video or RGB data from one or more 
slots 40-42. Graphics arbitrator 46 is operable to select the 
correct pixel for output and provide it to a video digital-to- 
analog converter 66, which generates an analog graphics output. 
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Graphics controller 62 is coupled to a graphics memory 64 
which provides data storage therefor. A pointer interface 68 is 
provided to coupled to a pointing device 22, such as a serial 
mouse. A bus interface 70 is provided for coupling and 
communicating with control area network 30. A flash memory 12, 
random access memory (RAM) 74, and a power supply/peripheral 
systems 76 are also included in display interface 12. 

In operation, output pixel selection by graphics arbitrator 
4 6 is performed by examining the color of each pixel arriving 
from graphics controller 62. Three predetermined colors have 
been selected as keys or indicators for the three slots- If a 
pixel is one of the three predetermined colors, then the pixel 
from the corresponding slot is selected as the output. If the 
pixel is of any other color, the graphics controller video 
graphics is chosen as the output source for that pixel. 
Therefore, graphics arbitrator examines the color of each pixel 
as it arrives from graphics controller 62. If the color of a 
given pixel is not one of the key colors, then the pixel is 
passed to video digital— to— analog converter 66 unchanged. If the 
pixel color is one of the key colors, then the pixel coming from 
the selected slot is passed to the output. 

FIGURE 4 is an exemplary screen of a main editor page 90 of 
editor 4 8 (FIGURE 2) with a page editing menu according to the 
teachings of the present invention. Editor 48 is used to create 
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and define the layout of the graphics display on the display 
monitor. Main editor page 90 may include an edit tool bar 92, 
which may include options: EXIT, BUTTON, PAGE, NEW PAGE, and 
QUIT EDITOR. A drop-down menu 94 for the PAGE option is shown, 
which includes several actions such as: add, copy, rename, 
delete, page color, go to, pop-up on, pop-up off, move editor, 
and snap grid. A page may be defined as a window which may 
occupy the entire or a portion of the display monitor screen. A 
page may include one or more buttons in which graphics content 
may be displayed. Also included may be a main button 96 for 
navigating to a main page and a setup button 98 for navigating 
to a setup page. 

FIGURE 5 is an exemplary screen of a main editor page 100 
with a button editing menu according to the teachings of the 
present invention. Main editor page 100 may include a edit tool 
bar 92 with a button pull-down menu 102 shown. Button pull-down 
menu 102 may include actions: add, copy image, move, resize, 
delete, text/image, properties, save, paste, save default, set 
default, and put on top. 

When the properties action is selected from button pull- 
down menu 102, an exemplary screen of a button property editing 
page 110 according to the teachings of the present invention is 
shown in FIGURE 6. A video window is a •type of button used to 
display a video feed from a graphics source. Video window 
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buttons can be moved, resized and customized. Button property 
editing page 110 includes a border button 112, for setting the 
button border. The button border property may include any number 
of ways to display or represent the border of the button, such 
as no border, single line, double line, triple line, single 
rounded, double rounded, single raised, double raised, 3D 
rectangle, 3D round, single diamond, etc. A button 114 is 
further provided in page 110 to set the channel code. The 
channel code allows a button to be associated with a specific 
function. A device (DEV) code is an identifier assigned to 
control devices coupled to master controller 28 via control area 
network 30 (FIGURE 1) . The CHAN designation on button 114 is 
the button channel assignment. Each device may have one or more 
channels. The next button, VAR TEXT 116, sets the variable text 
code for the channel and device assignments. The button type is 
set by the next field 118. Buttons may be of the following 
exemplary types: general, joystick, vertical bargraph, 
horizontal bar graph, keypad, keyboard, video window, etc. 
Button option 120 provides the user the ability to supply 
additional setup information about the button. For example, a 
video window button option would prompt the user to supply the 
slot number of the graphics source. Display interface then 
automatically detects the signal type of the graphics source 
connected to the given slot and set the video attributes 
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accordingly. The user may be given the opportunity to fine tune 
and optimize the VGA or RGB picture quality of the video window. 
Flip type button 122 is used to specify a page flip type and the 
next button 124 is used specify the page to flip to. For 
example, if the user specifies ''Flip Standard" and ''Main Page"', 
then when the present button is pushed, a page named "Main Page" 
is displayed. The next button, string 126, allows the user to 
specify a string associated with the button to be displayed. 

Buttons 128 and 130 are used to set the channel-off and 
channel-on display conditions of the button. The color of the 
border, the fill color, and the text of the channel-off and 
channel-on conditions of the button are specified. When property 
editing is completed, the user may exit and save the changes by 
pressing on button 132, or exit without saving the changes by 
pressing on button 134. 

Referring to FIGURE 7, a flowchart of an exemplary graphics 
arbitration process 150 of the present invention is shown. In 
block 152, graphics controller 62 generates an internal pixel 
map according to the display file. As described above, the 
display file contains the coordinates, size, and other 
information about the buttons on a given page. Some button 
properties may specify that video feed from one or more of the 
graphics sources 14 are to be displayed for a given button. In 
blocks 154 and 156, graphics arbitrator 46 receives the internal 
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pixel map from graphics controller 62 and examines the value of 
one pixel. If the pixel color value is a predetermined key 
color, then the desired display for that pixel is from a video 
feed from one of the graphics sources rather than the graphics 
generated by graphics controller 62. As described above, each 
graphics source is assigned a color value which function as a 
key. When the special key color is encountered, it is indicative 
that the pixel from the graphics source represented by that key 
color is to be displayed. If the pixel has a color value that 
matches one of the key colors, as determined in block 158, then 
the pixel data from the slot represented by that key color is 
obtained from the specified slot and output to video digital-to- 
analog controller 66 for output to the monitor. 

If in block 158 it is determined that the- pixel value is 
not a key color, then the pixel data from the internal pixel map 
is provided as output to video digital-to-analog controller 66 
for output to the monitor. In block 166, the next pixel in the 
internal pixel map is obtained, and execution loops back to 
block 156 to examine its value. This process continues until the 
display interface is powered down. 

Operating in this manner, graphics content from a number of 
sources may be combined and displayed on a single page on a 
monitor screen. The graphics sources may be those devices 
directly connected to the display interface, devices coupled to 

16 

DALLAS 1329671vl 



ATTORNEY DOCKET NO. 126239-1021 PATENT 

one or more additional display interfaces which are coupled 
together, or devices coupled to a control area network. 

Although several embodiments of the present invention and 
its advantages have been described in detail, it should be 
understood that mutations, changes, substitutions, 

transformations, modifications, variations, and alterations can 
be made therein without departing from the teachings of the 
present invention, the spirit and scope of the invention being 
set forth by the appended claims. 
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